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1. Background 


Parallelization of Rocket Engine System Software (PRESS) project is part of a collaborative 
effort with Southern University at Baton Rouge (SUBR), University of West Florida (UWF), 
and Jackson State University (JSU). 

The third-year funding, which supports two graduate students enrolled in our new Master’s 
program in Computer Science at Hampton University and the principal investigator, have been 
obtained for the period from October 19, 1997 through October 18, 1998. The interim progress 
report dated April 21, 1998 outlines the plans and progress in its relevant sections: 


Background 

Research Progress Overview 

Current Research Activities (October 1997 through April 1998) 

Future Plans 

Conclusion 


A noteworthy activity since that time was no-cost extension for an additional year with 
revised budget. The revised budget provides slightly more attractive stipend and tuition support 
for two graduate research assistants and provides release time and full time summer support for 
the principal investigator. Although, as shown on the authorization letter (See Appendix A) on 
July 7, 1998, the internal budget by Hampton University’s research and development office has 
only recently been entered into the computer system. This is due to the revised budget applying 
only to FY 99, starting on October 19, 1998 for this project. The project has fallen behind in 
spending rate (See Appendix B). We discuss this in more detail in Section 4.2. 

The key part of the interim report dealt with the acquisition of the working version of 
GASP (gas properties) module, referred to as GASPSheer. That was necessary for debugging 
and obtaining an executable for PUPMDES/TURBDES software which has been lent earlier to 
Hampton University under a software agreement. There is also the discussion of Pi’s 
presentation at the Fifth Annual HBCU Conference, April 9-10, 1997, Cleveland, Ohio. The 
presentation basically outlines distributed computing strategies for NASA’s Fortran-based 
software, in particular, the RENS and NPSS software at Lewis Research Center. The 
presentation focuses on the major challenge involving lack of support for Fortran-based software 
by distributed computing standards and software tools such as CORBA (Common Object Request 
Broker Architecture). As its name indicates, this most popular distributing computing standard, 
only supports object-oriented languages such as C + + , Smalltalk, and Java. More recently, it 
also provides limited support for Ada. Finally, there was some discussion of the work on C + + 
wrappers, in our case, using Microsoft Fortran 5.1 and Borland C++ 5.0, on PC platform. 
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2 . Research Progress Overview 


In this section, we give an overview of progress since the interim report filed in April 1998 

*™Z ti ° ned ^ ^ mterim rep0rt ’ 311 aim for this period was experimentation with 

MPI (Message Passing Interface) toward a demonstration of distributed computing over a local 
area network. Initially, the aim was to use a working version of PUMPDES or TURBDES 
software using the new GASP obtained from NASA LeRC with a new software agreement (See 
Appendix C). Later, with acquisition of what became known as SOURCCDS-folder modules 
under another software agreement (See Appendix D), it became clear that using the main 
executable module of that package would be more productive. That main module is 
RESSAP.FOR, where RESSAP is an acronym for Rocket Engine System Software Analysis and 
Performance. RESSAP.FOR is a preliminary source code, and has not been thoroughly tested 
However, RESSAP calls both PUMPDES and TURBDES modules, as well as other modules! 
Thus, it appeared that RESSAP would be a good candidate for experimentation with MPI. 


2.1 Message Passing Interface (MPI) Refresher 

MPI and its implementation on Hampton University’s SunOS based LAN have been 
discussed in detail in the Research Summary Report submitted on September 2, 1997. As a 
recap, we should briefly mention that it is a message passing interface standard intended 
pnmaniy for tightly-coupled distributed-memory systems. However, a SunSparc version 
MPICH exists, and this implementation provides a standard protocol, through a library and 
executable shells, for message exchanges. Note carefully that the underlying issues of remote 
“- s tobe done hy the s y stem ’ somehow, some way. Through Unix shell scripts (e.g. 
MPIRUN), and using SunOS and Sun’s NFS (Network File System) facilities, it is possible to 
assign processes to different network nodes. Indeed a cursory demo package which can also run 
on ACCL LACE cluster have been discussed in detail at that report. There, sample demos for 
MPI, as well as PVM, were discussed. The computation involves a two-dimensional 50x50 grid 
using Jacobi’s algorithm to solve the Laplace’s equation. The ultimate aim of that computation 
is to solve a linear partial differential equation. 

The best source for MPI is shown in [3], There some 128 routines and how those standard 

be u,voked " e discussed - The parameter blocks of calls such as 
MPI.SEND, MPI.RECV, MPI_SENDRECV_REPLACIi, etc. are long. They are also highly 
complex since the arguments are IN, OUT, or INOUT. At any rate, the focus of this reference 
source is on the intricacies of message passing among process groups and among processes 
within process groups. The discussion pays no attention whatsoever on the implementation 
issues involving various hardware problems. In effect, all the examples involve a single 
multiprogrammed processor node which run processes concurrently. Various fine issues such 
as deadlocks, barrier synchronization, producer-consumer problem and the like are discussed in 
great detail. Additionally, there are various calls for er*or handling and profiling. The 128 
routines which unfortunately makes MPI huge and complicated also involve various Fortran 90 
type constructs for data-parallel execution of loops involving arrays. In a sense, the focus is on 
fine-grain parallelism which is also supported by Fortran 90. For instance, one of the best 
examples, and there are only few examples, involve Jacoby iteration (Section 2.5, pp. 39-43). 
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Although MPI is intended for fine-grain parallelism with symmetric topologies of process 
groups, such as two or three dimensional meshes, we intend to use it for course grain 
parallelism. The main idea is to have an executable Fortran code, such as RESSAP (Rocket 
Engine System Sizing and Analysis Program), and use MPI to run its procedures on different 
network nodes. In addition, as will be discussed shortly, the fine grain parallelism in some of 
the modules, such as TABLE and NEWTON, can be exploited via so called intracommunicators. 
However, there is a question mark on that issue, since message passing delays are significant 
m a LAN. Therefore, the fine-grain parallelism over a LAN will probably incur too high a 
communication overhead. The suitability of MPI for parallelization of GASP which is called 
most frequently by PUMPDES/TURBDES software, is unclear to us at this time 


2.2 Analysis of the RESSAP Code 


Our familiarity with this code came from the content of SOURCCDS which, as mentioned 
earlier, was lent to Hampton University. In that directory, there are various source code 
modules left over from Dean Scheer’s work. Through experimentation, and using the code from 
the earlier TURBDES and PUMPDES system, we were able to obtain an executable a.out which 
corresponds to RESSAP main module. The listing in Figure 1 gives all the source modules 
along with inputs and outputs. We must mention that there is no documentation about RESSAP 
such as hierarchy charts showing the logical relationships and interfaces. 


Input 


modules 


150TPUT 


CPGG . DAT 
CPLL.DAT 
CPTP . DAT 
CSTARGG . DAT 
CSTARLL.DAT 
CSTARTP . DAT 
DEFALT . DAT 
DFTPMP . DAT 
DFTTRB . DAT 
GAMMAGG . DAT 
GAMMALL . DAT 
GAMMATP . DAT 
INTURB.DAT 
ISPTHPERGG.DAT 
ISPTHPERLL.DAT 
ISPTHPERTP.DAT 
MACHGG . DAT 
MACHLL . DAT 
MACHTP . DAT 
MACP . DAT 
MK480TRB . DAT 
PflGG . DAT 
PRLL.DAT 
PRTP . DAT 
REINPT.DAT 
RL10STG2.DAT 
TSTAGGG . OAT 
TSTAGLL . OAT 
TSTAGTP . DAT 
VISCGG.DAT 
VISCLL.DAT 
VISCTP . DAT 


ressap.for 
pumppd.for 
turbpd . for 
gasp .for 
f anno . for 
setup .for 
sgasp.for 
xbldlg . for 
xcstar ,f or 
xenth.f or 
xispid . for 
xleak . for 
xnewton.for 
xpfit .for 
xpmphd.for 
xreadp.for 
xstagt .f or 
xtable . for 
xtcapd . for 


f or015 . dat 
fort .20 


Figure 1: Source modules for a working version of RESSAP software 
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In this configuration, PUMPPD.FOR and TURBPD.FOR correspond to the previous 
versions of PUMPDES and TURBDES software. Note that, even though there is a calling 
sequence, as the debugging trace shown in Appendix E shows, these two modules are lareelv 

ta“LureT a ' , ° ther ' H ° WeVer ’ they do 0311 and share various other subroutine! as 


PUMPPD.FOR: TURBPD.FOR: 


CALL 

SETUP 

CALL 

SETUP 

CALL 

GASP 

CALL 

GASP 

CALL 

GASP 

CALL 

SETUP 

CALL 

SETUP 

CALL 

GASP 

CALL 

GASP 

CALL 

SETUP 

CALL 

GASP 

CALL 

GASP 

CALL 

GASP 

CALL 

TABLE 

CALL 

TABLE 

CALL 

TABLE 

CALL 

NEWTON 

CALL 

GASP 

CALL 

GASP 

CALL 

GASP 

CALL 

NEWTON 

CALL 

TABLE 

CALL 

GASP 

CALL 

GASP 

CALL 

LEAK 

CALL 

GASP 

CALL 

GASP 

CALL 

TABLE 

CALL 

GASP 

CALL 

NEWTON 

CALL 

BLDLG 

CALL 

GASP 

CALL 

PMPHD 



CALL 

GASP 




(appears 12 times in 12 places) 


Figure 2: PUMPPD and TURBPD modules sharing other sub-modules. 


As is clear, SETUP, GASP, NEWTON, and TABLE subroutines are shared. The SETUP 
is a Plotting program for the old VAX/VMS system, and therefore, need not be considered. 

NEWTON ^n^TA mr ^ a ^ond tier process group involving just GASP, 

? n ° N * rTifmyr^ Ca ? be estabIlshed - To reiterate, the first process group consists of only 
processes. PUMPPD and TURBPD. This is a highly unconventional use of MPI since as 
mentioned earlier, MPI is most suitable for a very large number of processes organized 
symmetrically, such as the grid structure. 6 

As the first step, we needed an executable which runs to completion and reports a very 
large amount of numerical data in for0015.dat. If there are error message, such as non- 
convergence reported by NEWTON subroutine, those a*e output on fort. 20. Unfortunately 
perhaps due to migration from VAX/VMS based sys em to Unix, there are arithmetical 
exceptions having to do with zero divides throughout the code. We have spent a great deal of 
time m debugging so as to be able to at least see what subioutines are run and in what sequence. 

pp(wt 1X E glVC f a ° f the ldnd 0f debu §S in 8 trace we attempted by embedding Fortran 

pn^PnTrTn^ Pr ° Pria i e Places ' ™ s 3150 gives a better idea about how - for i-aance, 

PUMPPD and TURBPD run the second tier sub-modules, including NEWTON and TABLE 
which are shared. c 
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2.3 Using MPI for RESSAP Code 

From the analysis above, it is best to use MPI’s point-to-point communication interface in 
between the two modules PUMPPD and TURBPD. In this case, there will be MPI’s 
intercommunication mechanism for the two sides of the point-to-point communication link. 
Having established message exchanges between PUMPD and TURBPD. One important 
parameter is MPI COMM WORD which is the default communicator that specifies the 
communication domain. This depends on the environment and specific implementation. For 
instance, suppose we have used the following process group: 

File name: pgroup 

apple 0 /users/cezzar/press/codes/ppp/ressap 
lemon 1 /users/cezzar/press/codes/ppp/ressap 
basil 1 /users/cezzar/press/codes/ppp/ressap 

In this case, MPI_COMM_WORLD will be established as the host machine apple with id 0 
initiating the run and the access to the other two machines through SunOS remote execution 
facility. Moreover, as a result of MPIRUN shell script, at least 3 initial processes, with ids 0, 
1,2,.. will be set up. As is mentioned earlier, the emphasis of MPI is with the intricacies of 
the logical aspects of process communications without attention to implementation issues. Once 
this is done, Figure 3 shows schematically and in an oversimplified way, how the MPI function 
calls may be embedded in the three modules. The numbers 0, 1, 2 refer to the process ids, 
where process 0 is the controlling process which must call MPIJNIT and only once. 


PUMPPD TURBPD 


call MPI INIT 
call MPI COMM SIZE 
call MPI_COMM_RANK 


call MPI SEND (2) 
call MPI_RECV (2) 

. . the source code 


. . the source code 

call MPI SEND (1) 
call MPI_RECV (1) 


call MPI SEND (0) 
call MPI_RECV (0) 

cail MPI SEND (2) 
call MPI_RECV (2) 


. . the source code 

. . the source code 


etc. 

call MPI_FINALIZE 




call MPI SEND 

(0) 

call MPI_RECV 

(0) 

, . the source 

code 

call MPI SEND 

(i) 

call MPI_RECV 

(i) 

. . the source 

code 

etc . 

/ 


Figure 3: A Schematic depiction of MPI function calls in RESSAP 
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is ' Ol^n^INOUT 3 “ m P lex P arameter structure where each parameter 

Hiffi/> uf ’ UU1 > and INOUT. In addition, the message is strongly typed where it i « 

fr»u U °t PaSS when Fortran subroutines are converted to MPI processes The 

following discussion elaborates on this issue. processes. The 


The embedded MPI call (See Appendix F for details) for sending a message to TURRPn 
and receiving an acknowledgement was, in effect, a substitnte for the subSe rSl ° 

< KFLU 10 ■ KTnBH . KINPT . NSTGH , Pt HThB , T1 HTRB , HPHPMP 

iilfisss&r 

aigunre^l^LU^as^^megw^ r^ie^Morwve^ae^sed 6 tire *tog*field > of'die'messt^ e^ 
arguments to " ‘u • “ fint argun ’ en( - Wha ‘ if we wa "<ed to pass alien the 

apUna^JS^ch T ‘"t 

possible to pass the pammeters as a block and sending is°a 

PnlC “ Ce eVe " if all0Wed > as with C - 1,16 ** “lution, in the S oTportiS i m 

r,hnV KT meterS “ " COMMON block - ^ ^ some reason that cannot be done^e have 

REAL *8^ and th^ 6 for of arguments of the same type (e.g say 

cannot do ^ ^ my t0 ** receiving P r <*ess. Note that, in the casTabove we 

cannot do this for all the arguments since the arguments are of different types. 

first Th^r* tl | lere may ^ t0 bC a reordering of arguments, where say all integer arguments 
first, then all real arguments, and so on. In that case, for each sequence as serarareF^n 

array needs tobe prepared. Thus, if many arguments need to be passed to another process the 

r szzszsL. r.srri •£■ - 

rf e Sgumems SUCh “ aPPr ° aCh W ° U ‘ d accom P' ish «"'<= *"* * required is the vies 


2.4 HBCU Conference Attendance 

We have submitted the abstract of our work to the Fourth HBCU Conference April 8-9 1997 
Cleveland Ohio. We also prepared a poster paper format and presented that on die sLo’nd dav 

Mw ,he p hen cana “ distribuKd com P uan s p acka «« 

l4J) ’ 30(1 CORBA (COmmon Object Request Broker Arthictecture) As will he 
bnefly discussed in the next section, CORBA is a rapidly growing in use lmd 

for Fortran ba^Sftv^e^ ^ eSentation at the conference was pointing out the lack of support 
or Fortran based software. This pnmanly stems from the fact that Fortran is not an ohierf- 

Fn^T 1 ^ gUag f h WC ’l 2 '! 6 ^ S ° 1)011116(1 out various alternatives such as C + + wrappers around 
Fortran code so that tools like CORBA can be utilized. The last viewgraph of ou7prerenZ n 

included some recommendations which is worth reiterating. The following is verbatim recap 
in a more concise format: s veroaum recap 
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Why not a more radical approach? 


• Redesign software based on Fortran 77 and Older along object-oriented 
principles 

• Translate the source code to an object-oriented programming language 
(C + + or Java) 

Biting the Bullet: Cons and Pros 
Cons: 

• Far greater price to pay for "going distributed" 

• Performance (Fortran code probably runs faster) 

• Physics and engineering-oriented NASA staffs close familiarity with Fortran is 
foregone 


Pros: 

• Redesign and reworking will improve the quality 

• Much easier to provide graphics-based user interfaces 

• Going distributed is much easier 

• Clear goals for and better utilization of grantees.. 


3. Trends in Distributed Computing 

CORBA, which has been discussed in conjunction with the NPSS design goals of NPSS in 

[5] , was featured in a recent issue of Component Strategies (formerly known as Object Magazine 

[6] . The article discusses the recent work of Object Management Group(OMG) in extending 
CORBA’s scope with respect to Java interface and support for Ada. It also discusses plans for 
CDL (Component Definition Language) which augments its IDL (Interface Definition Language). 
The article concludes with CORBA products becoming more robust and enjoying wider use in 
the future. 

This month’s issue of Communications of the ACM features CORBA on its cover and 
contain several articles [7-11]. Practically all aspects and future promise of this highly popular 
distributed computing standard are covered. An interesting aspect regarding COKRVs 
increasing popularity is that initially it was designed as a flexible tool with nairow scope. 
Perhaps one reason is simply the lack of other distributed computing tools. Another inteu sting 
aspect which is pointed out in article on CORBA 3.0 [9] is that CORBA can be regarded as an 
application integration tool. The same article discusses three significant new CORBA features: 
Portable Object Adapter. 

From the foregoing, it appears that close attention should be paid to CORBA as a viable 
distributed computing and application integration tool. As for MPI and PVM which is not 
further discussed in this report, their scope is narrow, and covers only the parallel machines or 
local networks with distributed operating systems. By the distributed operating system, we mean 
something like Sun’s NFS(Network File System, Solaris threading facilities, and the like. 
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4. Challenges and Remedies 


4.1 Technical 


All the Fortran based rocket engine design and simulation code that has been lent Hamntnn 
mversity under several software agreements as part of this (PRESS) project uses Unix 
platform. However, unfortunately, from the beginning of August 1998^ until the end of 

September' 1998 ZelTfT ^ haS Accessible At the end of 

1 9 , 98 ’ g y dUC 016 needs of thls a ver y lilted access to only a single 

node of the local net was provided. There are no remote login, email, or even* printing 

Tf y thC impIementation of MPI * «• was pointed out 
Meanwhile, the ACCL LACE cluster for which we have painstakingly obtained an account has 

clnstef n d °h in§ Wdl u lth6r! Indeed) since JuI y 1998 > we have been unable to access that 
cluster, perhaps due to the account being discontinued. 


4.2 Staffing 

5 e endre lhird “ d finaI year of this Project, we were enable to enlist the 
“ P ° f Eraduattestudent research assistants. This, despite the ample availability of funds in the 

budget, and for wo reasons. One is the economy doing well and our graduate students having 
iar more attract™ alternatives. The other, which is more important, is that ouTgraS 
program has shrunk from 16 to only a few students. graduate 

The revised budget which was submitted as part of the one-year no-cost extension provides 

support for two graduate students with higher stipends and tuition allowance limits However 

as pointed out in the introduction, our internal development budget has been entered into the 

computer system a few days ago. Based on this, we are in a position to aggressively search for 

f radU ^ te Student assu *" ts - 0ne plan we have is to enlist the help of a colleague, Robert Willis 
m sending emails to other HBCUs. 1U1S ’ 


4.3 Equipment and Software 

As was pointed out in the very first interim report of this project, at the start of the project we 
^ w obta \ n * P° werful computer platform. Instead, we ended up with two 

™ and 75 ^ HZ lapt ° P ’ Wlth limited memor y and hard disk unit capacity of 1 6 

• . F , 75 respectively. However, since Unix was the main platform for experimenting 
with Fortran based code, this did not much matter. However, if we are to move away from the 

° Ur W ° rk dUrin§ ^ ° ne ' year eXtenSi ° n *** ° n PC platform ’ these 

To this end, on the revised budget, $ 5K for hardwire and $ 7K for software Amiw 

items detailed are Lahey Fortran for PC platform and Visibroker (CORBA + Java) distribute! 

2! 8 However, these funds could be applied to software tools serving the same or 

“ ClCar ^ thC fUndS ^ ^ Sufficient for obtaining 
such integrated design environment^] tools as I-SIGHT. At this time, the only significant PC 

p a orm so tware we have is Borland’s C + + 5.0 with Java extension (jvm 1.0, the oldest). 
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5. Conclusion 

de m o^^°t n si:; h ''T?: f : f r n r d, H g period - we have sh ° wn h ° w a 

difficulties with the UNIX platform Wp have « * t C .' However ’ we 4180 mentioned the 
the presentation of the progress of the at Fourth Annual racU°COTferenc? tl ° nS "'** dUri " 8 

run in^fel ^n“ a " ““’m™ TOMDES/PUMPDES software can be 

ZZT ’ about MPI “« “ a p* '«*• s.“c 

information's ™tln,m ** of “** MPI, Uftle 

contrived examples, such as Jacobi algorithm for ^f 1 Very typica1 ’ s °mewhat 

examples wh^can readi.y be^ledt^ ^ “ ** 

mnm'Lf^ito toThHnlt^ £“ is a /°‘> ^cate 

tools for artificial intelligence research nmW tu a , UiP and LISP " llke languages as 
languages [12], when wSTSiJ, 8 , ‘ he develo P me "‘ ° f » book on programming 
reading and writing records multinlvino Z ° r VCr ^ SIm P* e samples like taking averages, 
much was a “’ ctc '; " “ uld hardly find a any! Ye, 8 so 

problem with MPI where despite significant a™ 10 clrcIes ' 11 a PP ears that we faced the same 
example w W ch ^ZS^SS^ ‘ 

reseafc™ duriSg f °tI M TT* ^ m ° re productive 

need to be done on Windows WWtadows NT L Jr ^ h [ the least - the research w °uld 

of Lahey Fortran package for PC platform.^d the^sdng torird^T'5 W 0 1,h ““ aCq “ isi,ion 
on C++ wrapper issues. exisung Borland C + -f 5 . 0, we can do work 

tenM 25 Sm/^I^r'd ? anS P“ rta ‘ ion Propulsion Integrated 
encouraging Esoeciahv ^J 1 , 31 “5 f ° und ““ lndus '°" of HBCUs in that effort 

HBCUs 1 liUgrow^d ^Lome beZ £^, 0 ^ 2 ^ is “ d ™M 
as was suggested in our presentadon at the men ° meailingfu research - I" the shorter period, 
aging Fortran based mZTfor ^tomSl^ SrT ^ ^ "*** the 
is whether or not object oriented lZuZe^lTcf + T, ZT. ° a£ im P° nant issue 
computing. Whether or not »Hi«S ? ° Java should be used for distributed 

another, farg^ qulon to £££?£*“* “ “ y ** ^ ye. 
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APPENDIX A: Authorization for No-cost 

National Aeronautics and 
Space Administration 

Lewis Research Center 
Cleveland, OH 44135-3191 


Extension of NAG3-1792 




NASA 


Reply to Attn of: 0612 

July 7, 1998 


Hampton University 
Office of Sponsored Programs 
Hampton, VA 23668 


Subject: NAG3-1792, Supplement No. 3 

In accordance with the clause of the grant entitled, "Extensions", the period of performance 
completion of the subject grant is hereby extended from October 19, 1998 to October 18, 

This authorization is conditioned upon the completion of the grant objectives within the 
current level of funding. 

This letter of authorization constitutes Supplement No. 3 to the subject grant. 



cc: 

ONRRO/ Atlanta 
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APPENDIX B: Internal Memorandum Concerning Spending Rate 


Hampton University 

HAMPTON, VIRGINIA 23618 


OFFICE OF THE VICE PRESIDENT FOR 
BUSINESS AFFAIRS AND TREASURER 
(757) 727-5213 
FAX 1,757) 727-5084 


MFMORXNninn 


TO 

Dr Ruknet Cezzar 
Computer Science Department 

FROM: 

Leon L. Scott 


V ice President for Business 
Affairs and Treasurer 

DATE: 

July 15, 1998 

RE: 

Unexpended Grant Funds 


Our records indicated as of, Jun e 30 , 1998 you have expended only.52 percent of your 
award which is due to expire on October 18 , 1999 , I am closely monitoring the spending rate of 

a grants^ ou must adjust your spending to meet the requirements of your award Please work 
with the Grants Management Office to spend. 


Grant NO 5 24048 Grant Description: NASA-Lewis Parallelization of Rocket Engine 


Budget 


Expenditures and Balance Percent 

Encumbrances Available Used 


$293,050 


$ 153,178 


$ 139,872 


Thank you for your cooperation. 


cc Dr Calvin Lowe, Vice President for Research 
Dr. JoAnn Haysbert, Assistant Provost 
Dr lohnnye Jones, Dean, School of Science 
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CCllEGE OF 
CONTINUING ED(jCa~ 


HAMPTON INSTITUTE 
THE UNOERGRAOUATE COLLEGE 


GRAOUATE COLLEGE 



Hl-L", V ~ 


APPENDIX C: Acquisition of new GASP module for PUMPDES/TURBDES 


National Aeronautics and 
Space Administration 

Lewis Research Center 

Cleveland, OH 44135-3191 


5880 December 22, 1 997 


Dr. Ruknet Cezzar, Associate Professor 
Department of Computer Science 
Science anc Technology Bldg, Room 120 
Hampton University 
Hampton, VA 23668 


Dear Dr. Cezzar: 

Per the recently signed Software Use Agreements, enclosed you will 

find three 3.5-inch diskettes containing the certran source code 

for the GASP (1 diskete) and GASPlus (2 diskettes) software. 

Note the following: 

. 1 ; There are manuals available for both packages. However, we 

nave no spare copies at this time, so it wi!_ ta,<e a while to 
get cooies made. Let us know if you want one or both of 
them . 

(2) The GASP source code is that used by Dean Scheer when he 
developed the PUMPDES and TURBDES codes for wh-.cn you war._ to 
use it*. 3ob Hendricks inserted some lines up front to print 
out hydrogen property tables . You will have to remove 
these lines and make whatever modifications are required 

to get it to run with the noted codes . 

(3) The GASPlus code is configured to run in a DCS-based, stand- 
alone mode. You can use it to check cut the results obtained 
with GASP software. 

I hope you find both of these software routines useful in carrying 

out your work under NASA Grant NAG3-1792. 

Sincerely, 

/ 1 /YY>VV r* 


Engine Systems Technology Branch 
Turbomachinery & Propulsion Systems 

3 Enclosures 
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Reply to Attn or 


APPENDIX D: Acquisition of Miscellanous Modules Including RESSAP 


National Aeronautics and 
Space Administration 

Lewis Research Center 

Cleveland, OH 44135-3191 



5880 

.MAY J 8 1938 

Dr. Ruknet Cessar, Associate Professor 
Department of Computer Science 
Hampton University 
Science and Technology Building 
Room 120 

Hampton, VA 23668 


Dear Dr. Cezzar: 

-nclosea you will find three 3 . 5 " rloppy diskettes containing 
archival tiles from Dean Scheer' s work on the Pumpdes and 
-erodes Codes which have already bee i delivered to you. 

They include: 

1. Documentation files (in the TPDESDOC folder; for Pumpdes, 
Turbdes , and other routines; Word Perfect format; 
readable in MS Word) 

2. Fortran source files (in the SOURCCDS folder; 

3. Miscellaneous supporting files from his VAX account (in 
the MISCVAXF folder) . 

- nope you rind them useful in carrying out the work under 
NASA Grant NAG3-1792. 



engine Systems Technology Branch 
. uroomachinerv and Propulsion Systems Division 

3 Er. closures 
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APPENDIX E: A Typical Debugging Trace for A RESSAP Run 


ressap: returned from READFILE a090 

ressap: returned from ENTHALPYLEVEL a128 

ressap: returned from THEORISP a130 

ressap: returned from STAGTEMP a132 

ressap: returned from CSSTARSUB a134 
ressap: returned from TCAPD a146 
Hello I’m pumppd! 
pumppd: returned from SETUP a270 
pumppd: Parameters passed to GASP: 

1 15 42.400000000000 168.00000000000 0. 0. 0 

pumppd: returned from GASP a276 

pumppd: returned from GASP a283 

pumppd: returned from GASP a319 

pumppd: returned from TABLE a374 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a49 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 1 

pumppd: returned from NEWTON a491 Flag KFLG10 = 3 

Line 582: 0.24242338831148 0.35570149921394 0. 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 
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APPENDIX E: A Typical Debugging Trace for A RESSAP Run (Cont’d) 


pumppd : returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 * 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 1 

pumppd: returned from GASP a555 

pumppd: returned from NEWTON a557 Flag KFLG20 = 3 

pumppd: returned from GASP s570 

pumppd: returned from LEAK s579 

pumppd: returned from GASP s595 

pumppd: returned from GASP s606 

Line 713: 0. 0. 0. 

Line 735: 1.0000000000000 0.60876135403851 0 

pumppd: returned from BLDLG s661 

FRICFB = 9 . 3778428720395D - 02 

BNDRAD= - 4 . 6722675622228 

HYDDBN = 9. 20307355575700-02 

pumppd: calling PMPHD 729 

pumppd: returned from PMPHD s726 

pumppd: returned from GASP s775 

pumppd: returning to ressap! 

ressap: returned from PUMPPO a168 

ressap: returned from FANNO a178 

ressap: returned from SGASP si 99 

ressap: returned from FANNO s226 

ressap: returned from TURBPD s244 

ressap: returned from PUMPPD s270 

ressap: returned from FANNO s283 

ressap: returned from NEWTON s300 

ressap: returned from TURBPD s324 

ressap: returned from FANNO s333 

ressap: returned from FANNO s337 

ressap: returned from SGASP s349 

ressap: returned from FANNO s358 

ressap: returned from NEWTON s374 

Go to flag 375 0 

Successful completion of calls! 
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APPENDIX F: Parts of RESSAP Source Code Relevant to MPI 


0 ***************** MPI re i a ted declarations ***************** 
parameter (control id= 0 ) 

C Control-id is the icl of the process, in this case process 0 
CHARACTER*20 sjnsg 

INTEGER i msg, myrank, ierr, status (MPI_STATUS_SIZE) 

C Note: MPI_STATUS_SIZE is system implementation dependent 

REAL *8 r_msg 
c 

c Global variables for ressap.for 

COMMON /globals/ my id, nprocs 
These are the process i3 and number of processes 

*************** End Q-f ypj related declarations ************ 


ROCKET ENGINE SYSTEM PRELIMINARY DESIGN CODE 
IMPLICIT REAL*8(A-H,0-Z) 

REAL*8 MU , MUL , MUV , K , KL , KV , ISPGG , ISPTP , ISPLL , ISP , ISPACT , MACHGG , 

1 MACHTP , MACHLL , MACH , MIX , LEVEL1 , LEVEL2 , LEVEL3 , LSTAR , LF , NSSH2P , 

2 NSH2P , NSS02P , NS02P , LPR IME , LN , ISPSV 
DIMENSION ISPGG(10,11 ,14) , ISPTP (10, 11 ,14) ,ISPLL(10,11 ,14) , 

c TSTAGGG( 10,11) ,TSTAGTP( 10 , 1 1 ) ,TSTAGLL( 10, 11), 

c CSTARGG (10,11), CSTARTP (10,11), CSTARLL (10,11) , 

c CPGG(10,11 ,15) , CPTP( 10,11 ,15) , CPLL(10, 1 1 , 15) , 

c GAMMAGG (10,11,15) ,GAMMATP ( 1 0, 1 1 , 15) , GAMMALL (10,11 ,15) , 

c MACHGG(10,11 ,15) ,MACHTP( 10 , 1 1 , 15) ,MACHLL( 10, 1 1 , 15 ) , 

c VISCGG(10,11 ,15) , VISCTP( 10 , 11 ,15) , VISCLL( 10, 1 1,15) , 

c PRGG( 10,11 ,15) ,PRTP(10,11 ,15) , PRLL( 10, 1 1 , 15) , 

c PRES (10) ,MIX( 1 1 ) ,RATI01 (15) ,RATI02(14) 

LABELED COMMON STATEMENTS FOR H2/02 PERFORMANCE AND PROPERTIES 

COMMON/ ISPTAB/ ISPLL, ISPGG, ISPTP 
COMMON / TSTAGTAB / TSTAGLL , TSTAGGG , TSTAGTP 
COMMON /CSTARTAB/ CSTARLL , CSTARGG , CSTARTP 
COMMON / CPTAB / CPLL , CPGG , CPTP 
COMMON /GAMMTAB / GAMMALL , GAMMAGG , GAMMATP 
COMMON /MACHTAB / MACHLL , MACHGG , MACHTP 
COMMON / VISCTAB / VISCLL ,VISCGG,VISCTP 
COMMON / PRTAB / PRLL , PRGG , PRTP 
C0MM0N/GR0UP1 /PRES, MIX, RATI01 
COMMON /GR0UP2/RATI02 

COMMON / ENTHALPY / LEVEL1 , LEVEL2 , LEVEL3 , DELTAHMIX 
LABELED COMMON STATEMENT FOR “GASP" 

COMMON / PROPTY / KU , KZ , DL , DV , HL , HV , S , SL , SV , CV , CVL , CVV , CP , CPL , CPV , 

1 GAMMA, GAMMAL,GAMMAV,C, CL, CVP, MU, MUL, MUV, K,KL,KV, SIGMA, 

2 EXCL , EXCV , EXCESK 

C Source code continued on the next page ===============> 
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APPENDIX F: Parts of RESSAP Source Code Relevant to MPI (Cont’d) 


Notes on DATA statements for hydrogen/oxygen performance 
and property tables 
PRES - pressure is in psia 
MIX - mixture ratio (0/F) 

RATI01 - RATI01 data are the natural logarithms of thrust 

chamber contraction and nozzle expansion area ratios. 
Contraction ratios are negative, expansion ratios are positive 
RATI02 - RATI02 data are the natural logarithms of nozzle expansion 
area ratios. 


C 


C 


DATA PRES / 20 . 0 , 50 . 0 , 1 00 . 0 , 200 . 0 , 300 . 0 , 400 . 0 , 500 . 0 , 

C 1000.0,2000.0,5000.0/ 

DATA MIX/2. 0,3. 0,4. 0,5. 0,6. 0,7. 0,8. 0,9. 0,10. 0,11 .0,12.0/ 
DATA RATI01 / - 1 .60944,-1 .38629,-1 .09861 , - .69315, .0, .69315, 
C 1.09861,1.38629,1.79176,2.30295,3.40120,4.09434,4.60517 
C 5.70378,6.39693/ 

DATA RATI02/ .0, .69315,1 .09861 , 1 .38629,1.79176,2.30295, 

C 3.40120,4.09434,4.60517,5.70378,6.39693,6.90776,7.09008, 
C 7.31322/ ’ 


NAMELIST /DEFALT / THETAC , THETAN , EPSRNA , EPSRNE , EPSE , EPSC , LSTAR , LF , 
82BLDH , BLDTKH , WRAPH2 , H0VTH2 , NSSH2P , STGSH2 , BLDSH2 , EPSH2 , UTMH2P 
INRLBH,RLABYH, INNLH,NLH, INCLRH,CLRLH, ’ 

B2BLD0 , BLDTKO , WRAP02 , H0VT02 , NSS02P , STGS02 , BLDS02 , EPS02 , UTM02P , 
INRLBO , RLABYO , INNLO , NLO , INCLRO , CLRLO , 

KTRBH , NSTGH , UTMH2T , AOVRDH , CNOHNH , ALPH2H , CLRH , 

KTRBO , NSTGO , UTM02T , AOVRDO , CNOHNO , ALPH20 , CLRO 

NAMELIST/ RE INPT/FV AC , DPRES , DMIX , DRATIO , PIN02B ,TIN02B , PINH2B , 

1 TINH2B , PI OPMP , T 1 0PMP , PI HPMP , T1 HPMP , DPOIJF , DPHI JF , DPCOOL , QCOOL , 

2 RPMH2P , RPM02P , WTBPF , WOTBPF , DPHCVF , DPPMOF , DPOCVF , ETADH2 , ETAD02 

3 THETAC, THETAN, EPSRNA, EPSRNE, EPSE, EPSC, LSTAR, LF, 

4 B2BLDH , BLDTKH , WRAPH2 , H0VTH2 , NSSH2P , STGSH2 , BLDSH2 , EPSH2 , UTMH2P , 

5 INRLBH , RLABYH , INNLH , NLH , INCLRH , CLRLH , 

6 B2BLD0 , BLDTKO , WRAP02 , H0VT02 , NSS02P , STGS02 , BLDS02 , EPS02 , UTM02P , 

7 INRLBO, RLABYO, INNLO, NLO, INCLRO, CLRLO, 

8 KTRBH , NSTGH , UTMH2T , AOVRDH , CNOHNH , ALPH2H , CLRH , 

9 KTRBO , NSTGO , UTM02T , AOVRDO , CNOHNO , ALPH20 , CLRO 


0* *********************** Mpi re i a ted calls ************************* 
C 

call MPI_INIT (ierr) 

call MPI_COMM_SIZE (MPI_C0MM_W0RLD, nprocs, ierr) 
call MPI COMM RANK (MPI_C0MM_W0RLD, my_id, ierr) 

C gets numFer of procecess and its id, it can now 
C compare my_id with control id if need be 
C 

q** ****************** * End Q-f mpi related call* ********************* 
C 
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APPENDIX F: Parts of RESSAP Source Code Relevant to MPI (Cont’d) 


HYDROGEN PUMP DRIVE TURBINE SIZING AND PERFORMANCE 


******* This call is replace by MPI message sent to TURBPD ******** 

CALL TURBPD ( KFLU ID , KTRBH , KINPT , NSTGH , PI HTRB , T1 HTRB , HPHPMP , 

1 WTRBH , RPMH2P , UTMH2T , AOVRDH , CNOHNH , ALPH2H , CLRH , HPTRBH . DMTRBH , 

2 UMTRBH , UCTRBH , ETATSH , ETATTH , HI HTRB , D1 HTRB , P2HTRB , T2HTRB , 

3 H2HTRB , D2HTRB , S2HTRB , KTYPEH , ANSQDH , ADMH , Z1 H , CPI H , GAM1 H , 

4 UTTRBH , HTR 1 H , HTR2H ) ' 

************* enc j 0 -f replaced subroutine call ********************** 




MPI related calls ************************* 


prepare the message as one integer value, and process id = 2 
i msg = KFLUID 
itCproc = 2 

This sets the receiving process id to 2, which is TURBPD 
i tag = 1 

Tnis sets the position of the argument passed to TURBPD 
call MPI_SEND (ijnsg, 1, MPI INTEGER, 

* id_proc, I_tag, MPI_COMM_WORLD, ierr) 

this sends the first argument, KFLUID, as the message to the 
process TURBPD whose process id is 2 

there are various alternatives, none too attractive (!), for 
sending all other argument values to the TURBPD process 
see the discussion in the Section 2.4 for more information 

call MPI_RECV (sjnsg, 20, MPI_CHARACTER , 

* 0, i_tag, MPI_COMM_WORLD, status, ierr) 
receive a 20 -char message, perhaps as an acknowledgment 




End of MPI related calls ******************* 


NOTE: The rest of the source code for RESSAP 


Any other call to TURBPD will be replaced by a message send in 
the same way as was done for this call 




MPI related calls ************************* 


call MPI_FINALIZE (ierr) 




STOP 

END 


End of MPI related calls ********************* 
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